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FOREWORD 



What follows is designed to provide an overview of the 1979 Illinois, • 
Inventory of Educational Progress (HEP) in fourth grade mathematics. The 
test has been administered by the Illinois State Board of Education since 
1976; however , v this analytical report is in a new and- more usable format. 

Development of the HEP is discussed,^ and results and analyses of the test 
administered to fourth grade students are presented. Results .and analyses 
of eighth and eleventh grade- tests can be found in separate reports. It is 
hoped that the information contained here will enhance- instruction in 
Illinois schooTs. 

• While many state staff members contributed to the preparation of this 
report, I would like to'especially acknowledge the efforts of Dr. Mervin M. . 
Br-ennan as the main writer. Any questions concerning this report^may be 
addressed to Dr. Brennan or Dr. Thomas K^rjns, Manager of the Program 
Evaluation and Assessment Section of the Department of Planning, . Research 

* and Evaluation of the Illinois State Board of Education. 




Donald G. Gill 

State Superintendent of s Education 
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PREFACE 

Purpose ; « . ^ * 

The Illinois Inventory of Educational Progress (HEP) is a systematic effort 
by the Illinois State Board of Education to collect information on the, 
educational achievement of Illinois students in certain areas and to make 
that information available to. educational decision^ makefsV 

The th^ee goals of the-IIEP are: 

1) to. make available relevant, reliable, and valid data on the educational 
attainments of Illinois students; 

2) to identify any trends (growth, stability, or decline) in educational 
attainments which occur over time; and 

3) to publish results of the research conducted in connection with the HEP* 
Student- Selection 

A random sample with two sampling stages is-used to select those students 
attending Illinois public schools who will participate. 

First, schools throughout the state are chosen randomly. A sample of 
fourth, eighth, and eleventh graders is then randomly selected from lists of 
eligible students submitted by schools for participation. These grade, 
levels are selected to correspond roughly with the end of the primary, 
elementary, and secondary levels of education. * ' . 

Since the HEP is geared toward determining how groups of Illinois students 
perform on given tasks, no individual student, teacher, school, or district 
is identified in any reports of the results. 

Type of Test 

The HEP employs an objective-referenced approach. An objective-referenced 
assessment instrument assesses student performance. Desjred student 
performance is expressed in terms of objectives. An objective is a 
statement of desired student performance, for example: "Fourth .grade 
students should be able to recognize geometric shapes Such as. circles, • 
etc." Student performance is measured by test rtems designed to determine 
whether or not certain groups of students are able to 'do what the objectives 
state .they should be able to do. < 

Subject Areas 

The/IEP has been in exi*tence since 1976. A number of- subject areas hav*. 
been assessed, for example, reading, mathematics, science, citizenship, . 
energy and nutrition, as well as student attitudes about themselves and 
education in general. * 9 % . % " / . 

Base line data is collected during the first year that any subject area is 
assessed.' For each succeeding year that a subject area is reassessed, 
comparisons cart be made concerning student performance on specific 
^objectives, and any growth £>r decline In achievement* can be noted. 
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"CHAPTER 1 




'Ill.inois Inventory, of Educational Progress - Mathematics 
Development of the 1979- Mathematics-HEP * • 1 



N[n the spring "of 1978, a panel of six mathematics educators with k elementao 
junior high, high school, and college teaching and administrative experience 
was convened 'to assist State Board staff in formulating the 1979 mathematics 
HEP (a' roster of panel members appears in Appendix D). Charged with 
f redrafting the objectives which had. been developed for the 1976. HEP, the 
group met over a two-month- period. The results of the,ir woi*k are discussed 
later-in this repdrt. r r 

Additionally, results of a teacher survey that was administered with the 
previous year's HEP (1978) were used in developing the 1979 mathematics 
HEP. Produced by State Board staff, the survey sought to: (1)' validate 1 - 
the test; (2) supply an additional perspective on the results; and (3) 
provide a standard of performance, based upon teacher estimates, with which 
student results could te compared. . 4 

Toward that end, one Mathematics teacher from each school which participated 
4n the HEP was asked to do three things for each test .i tem. Teachers- were 
asked to determine (1) whether, students had been exposed to the material ana 
.(2^ whether the item was of an appropriate level of difficulty. Teachers 

- were also ask^ed (3) to estimate the 'percentage of students that could be 
expected to 'answpr each item correctly. A sample of the teacher survey is 
contained .in Appendix C. Results of the teacher suWey are discussed in' 

. Chapter 2. » 



The test was a domain and objective-referenced test, which means simply that 
.the items tested the general domain of mathematics and that items are 
derived from or'keyed to a set of curricular objectives. 

- Mathematics objectives for the 1979, HEP were. developed by the ' .. 

aforementioned panel of .educators. The following mathematics topics and 
abilities reflect those objectives. A list of topics precedes a summary 
description of abilities. Some of the topics are self-explanatory; a brief 
definition is provided for those which are less common. The abilities are a 

• bit more detailed; essentially, they are the skills required for success in 
mathematics. Each mathematics objective describes a particular ability with 
reference to a spec#ic topic. 



The Test 



Mathematics Topics / - ; 

I. NUMERATION .CONCEPTS! This topic refers to the concepts of 

numeration and'place value, and the processes of naming numerals, 
approximating numbers, and rounding off numbers. 

'II. PROPERTIES OF NUMBERS AND OPERATIONS. Yhis topic also includes 
characteristics of numbers and operations ancK comparisons among ' 
numbers. • ■ • • •* 

III: NUMBERS. • 

A. WHOLE NUMBERS. Whole numbers are the. numbers used' by children 
to count. Whole numbers^ include 0,. 1, 2, 3, jttc. 

• B.- FRACTIONS. 

1 

C DECIMALS. 

D. PERCENT. ' * . 

~ ' ' . " V 

E. INTEGERS. Integers are positive and negative whole numbers 
and zero as distinguished from fractions. The numbers -3, .-2, 

/ -1, 0,'+l, +2, +3, etc.^are integers. * 

F. RATIONALS^ Rationals is an all-inclusive term for topics A 
through E, both positive and negative. Examples are +2, +1/2, 

j-.- +.50, +50*, -2, -1/2, -.50,. and r50*. * 

G. REALS.' Reals is\an all-inclusive term for topics A through F 
and numbers, such as <ff , / VX» etc. 

IV. MEASUREMENT. 

V. . ALGEBRA. 1 
VI. . GEOMETRY. ' ~ % 

VII. PROBABILITY AND STATISTICS. 

/III. . PERSONAL AND CONSUMER MATHEMATICS.' . * ' 

\ 

Mathematics Abilities . * • , 

; . z 

1. Ability to recall and recognize facts, definitions, and symbols * 
quickly. Perception is the primary mental ^act used. * 

2. Ability to perform computations, procedures, and complex 'counting 
where the operations are Indicated* 

3. Ability to understand concepts, facts, and processes. The mental 
- operations of analysis*and synthesis are used" to make comparisons 

»» and' evaluative judgments. 



4. Ability to solve complex word problems. Several .of the following 
operations must be involved: interpretation of the question, 
identification of the relevant data' from* the givea information, . 
decisions about which operations heed to be performed on the data, 
correct performance on the operations and interpretations of the 
results. v _ 

Each mathematics item tested a student ability with respect to one of the 
mathematics topics. The matrix of mathematics topics and abilities. (Table 
1) shows the conceptual mo'del of the HEP mathematics tests. Each cell of 
"the matrix is a specif ic. mathematics objective. y 

The test contained items on six topics and four abi-Ti ties. There were items 
-related to 13 objectives witMn the topics and abilities. A topic,'-~3bi lity, 
or objective was considered to be measured if there were three or more item; 
testing it; By that- standard,, the test measured -six. topics and four 
abilities, and eight objectives within them. The test is described more 
fully in subsequent chapters of this report. 



Mathematics Top ids 



I. NUMERATION CONCEPTS 

•II 4 PROPERTIES OF NUMBERS. 

. AND OPERATIONS 

III. NUMBERS ' 

A. WHOLE NUMBERS 

B. FRACTIONS 

C. DECIMALS * k 

D. PERCENT 

" E. INTEGERS 
* F. RATIONALS , . 
G. REALS 

IV. MEASUREMENT 

Vr ALGEBRA 



VI, 
VII. 

Hill. 



' TABLE 1 • 
MATRIX OF MATHEMATICS OBJECTIVES 

. MATHEMATICS' CATEGORIES BY ABILITIES . ' 

Mathematics Abilities 



Ability to , 
recall and 
recognize facts, 
definitions, and 
symbols quickly 



GEOMETRY 
PROBABILITY AND 
STAT I ST ICS* 

PERSONAL 'AND CONSUMER" 
MATHEMATICS ' 



* The numerals (4, 8, k 
1979 HEP. 



-1 
5 



9 

T3 
T7 
71 
15 
29 

s 

37 
41 

■m 

49 

53 



*4 . 
.4, 8 



4 
8 



4, 8 
11 

8 



Ability, to 
perform 
computations, 
procedures, and 
complex counting 
wheYe the 
operations are 
indicated 



2 
6 



10 
14" 
Iff 
H 

f 

M 

38 

42 
H 

50 
54 



-a 



8 ' 



4, 8, 11 

u 

8 

8. 
4, f 8 



8, 11 

8> 11 

11 

'4, 8 



.3. 

Ability to 
understand 
concepts, 
facts, and 
processes 



3 
7 



11 
.IS 
19~ 

27 

/ 3T 

H 

39 



8 
4 



8 
11 



11 
8 



43 

V 8, 11" M 



51 
55 



4 

Ability to 1 
.solve -complex 
word problems 



■ # 

4 

8 *8 



12 
15 
2S 
"2? 
2$ 

1 
40 

44 



52 
56 



By 11 - 

8, 11 

4, 8 
11 

11 



4 - 8, 11 

* » 

11) indicate the grade level (s) at which these items were tested tn the., 



Chapter 2 
ITEM RESULTS 



As mentioned in Chapter 1, teachers of participating students were asked to 

estimate the percentage of students who would obtain the correct answers to 

the .items. The hypothesis was that the teacher estimates would b,e hiaher 

than the student scores. Chapter 4 shows the statistical results. » * / 

It was anticipated that there would be some discrepancies between teacher 
estimates and. student V:ores which could not be submitted to, statistical • 
tests orWuld not reach significance levels, but would lend themselves to 
suggestions for future research. 'After statistical analysis of the data, 
exper>enced Illinois mathematics educators were asked to comment on the 
results. ' 

The following .descriptions were used for discrepancies between teacher 
estimates and. student scores: ■ 

approximating for discrepancies of ten or less percentage points, 

higher than/lower than for "discrepancies of 11 'to 20 points, and 

considerably higher than/lower than for discrepancies of more than « 
, 20 points. 

These discrepancy guidelines were established because consultants suggested 
the use of consistent standards. Ten percentage points was used since \ 
standard deviations for previously calculated data were ,usu ally near .1Q. 

The panel of mathematics educators were asked to Analyze and interpret the 
test results using the test data and the teacher survey data. They 
reflected upon the data for each curricular topic and each objective within 
the topics> This chapter gives the data and the panel's comments. Correct 
answers are underlined. Teacher estimates are abbreviate^ as teach. est. ,t 
Student sc ores are abbreviated as stu. score . • 

The comments are solely those of the experts and are not to be taken as the 
official position of the State Superintendent of Education or the Illinois 
State Board of Education . ' — ~ — • ! T *. , 

i ^ 1 
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Topic I: Numeration Concepts 
The test contained four items on this topjc. . Table 2 shows the results. 

Table 2 

Objective !: ' Recognition of* Numeration Concepts 
Item 30. What digit is in.,t'he tens'#lace in 4,263; 

' * i H 

% 

a. 2 feeach. est.: 83% 

b. 3 4 * stu. score: 78% 

c. 4 j, 

d. 6 , ' 

Item 34. Which of the following is true? 

a. 653 ,804 < 653,084 ^ - * teach', est.: 69% 

b. 653,804 >: 653,084 " stu. -score: *61%" 
T. 653,804 = 653,084 

> .Item 31. 1029 is written as 



a. ten hundred twenty-nine . teach, est;: 74% 
ten thousand twenty- nine*, stu. score: . 40% 
c. onetthou^and two hundred nine. 



Item 41. Four and two-fifths is written as 



a. 42/5 • • teach; est..:. 49% 

b. 4/25/ stu. scjore: 73% 



* i 



c. 4 2/5 

"dT None of these 



1 
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Panel Comments ; Student scores approximated teacher estimates for items 30 
and 34. Scores were considerably lower than the. teacher estimate for item 
31. In regard to item 31, the panel noted that fourth graders are usually 
taught to read the numerals 1029 as "one thousand twenty-nine." Hany students 
may not have known that "ten hundred twenty-nine is also correct." Student 
scores were considerably higher than teacher estimates for item 41, which 
related to understanding numeration concepts. 

* 

Topic -II: Properties of Numbers and Operations 
There were six items on this topic. Table' 3 show's the resultsv'A^ : 

Table 3 ■ 4 



Objective 5: Recognition of Properties of 
. . Numbers and Operations 



.Item 42. The figure below is divided > into equal 
parts. What fractional part is shaded? 




d. 3 



13 

- 7 - 



Item 29. What' is the next larger odd number after "5? 



a. 6 

b. 7 

~. 8~ 



teach, est. : 77% 
stu. score: 70% 



Item 33- Which, of the following is a prime number? 



a. 
b. 



c. 
.d. 



12 
13 
"15 
18 



teach, est.: • 32%' 
stu. score: 24% 



^Item 32. Which of the following is a prime number? 



a. 6 

b. 7 

c. , 9 

d. 15 



% teach, est.: 33% 
- stu, score: 18% 



Objective 7: Understanding, of Properties of Numbers 
and Operations 



Look at the drawings below and answer thejjuestions 
that follow. 





4- 





Item 39. What fractfon of the figlires are, circles? 



> » 



6 

a. 



4* 
4 

3 
7 



teach, esf. : 51% 

stu. scores 47% 
t 



c. 



2 
7 



r 



d. 4 

• 7 



14 



Item 40: What fraction of the figures are geometric 
shapes'? 

a. 3 teach. 'est.: 44% 
7 1 stu. score: 29$* 

b. 7 VS •> • 

7 - * 

c: .4 . 
7 • • .' 

(J. 2 ... 
7 



Panet Consents : -The- student average score (47%) approximated the teacher 
estimate (50%). for objective 5., The rancje of scores was large, from 77% to 
18%. Sixty-two percent of the teachers responded in the itEP- teacher survey 
that their students had received no exposure to the material tested by items 
32' and 33— They said those items' were too 'difficult. Fifty-three percent 
of the teachers reported little or no student* exposure jko the material 
tested by item 42. The student score (74%) was higher than' the teacher 
• estimate (57%) for thaft item. Sixty-two percent of the, teachers also 
reported .little or no exposure to the material tested by the items related 
to objective 7. The student average score for the objective was 38%; the 
teapher estimate was 48%. . 




Topic III:. Numbers 



*\The test contained 11 items .on thfs topic. Eight items were related to 
whole numbers; three items tested integers. 

Whole Numbers 

Whole numbers were tested by one item on objective 9, four 'items on * 
objective ten, and three items on objective 12. Table 4 shows the results. 



Table 4 

Objective 9: ^Recognition of Whole Nymber Facts 
Item 26. Divide: 9-f 3 = 

a. 3 ^ teach, est.: 85% 

5" stu. score: 86% 

c. 12 



a 1 
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Objective 10: Computation of Whole Numbers 



Itenl 25. Multiply: 38 

11 

a. 342 - ^tea'ch. est.: 77% 

b. 272 ' stu. score: 83% 

c. 2772 

d. 372 . x 
» 



Item 28. The number that is 200 less than\jB00 i« 



a. 1000 teach, est.: 81% 

b. 400 stu. score: 78% 

c. 600 



Item 23.. Find the difference:, 2043 ■ 

- 317 

a. 1,736 teach, est.: 76% 

b. 1,627 • stu. score: 78% 
»c, 1,72*6 

d. IJW f 



Item 27. 'What number is 3 more than 999? 

a. • 2,997 /. teach, est.: 79% 

b. 996 * ^ / stu. score: 73% 

c. 333 / . 

d. 1,002 



'Objective 12: Problem Solving Using^Whole Numbers 
* 

Item 47. An, astronaut is to orbit- the earth in a 
' ■space capsule for seven days. If he drinks three 
pints of water each day, how many pints of drinking 
water will be needed for >the trip? 

* * - - 

a. 4 pints teach^est.: 69% 

U -7 pints '.* • stu^score: 73% 

c. 10 pints ^lik; 

f d. 21 pints 



- < 16 

- 10 - 



/ 



f • 



Item 45. John has. 385 s£amp,s in his stamp 
collection. Greg has»230, Pete has 310 and Bob has • 
175. The number of stamps. the boys have all together 
is: 



a. 900 stamps teach, est.: 77% 

b. 1,000 stamps \, stu. score: 68% 



c. 1,100 stamps 
(T 1,200 stamps 



,Item 49.- A sports car owner says that the car gets 22 
miles'per gallon of gasoline. How many miles couTd 
the car go on seven gallons of gasoline? 



» 



a. 



» 



144 miles teach, est.: 65% 

b. 154 miles stu. score: 65% 

T. 164 miles 
d. 174 miles 



Panel Comments : The student scores on whole numbers approximated the 
teacher estimates for the topic as a whole, for each objective, and for the 
individual items. • For the topic, the student score was 76%\ which was 
identical to the teacher estimate. For objective 9, the student score was 
.86%; the teacher "estimate was 85%. For objective" 10, the student score was 
78%, compared to the. teacher estimate of 78%. For objective 12, the student 
V score was 69%, compared to the teacher estimate of 70%. Student scores • 
'^ranged from 86% to 65% for whole numbers. The highest score was on item 26, 
which was on recognition of whole number facts. The lowest score was for 
item 49, which tested problem- solving ability. As shown in table 5", post o 
hoc analysis indicated that students scored significantly higher on 
" -computation (objective 10) than in problem solving (objective 12). 

J 

\ * 

Integers % . % 

Three items measured objective 26. Table 5 shows the results. 



Table 5 



Objective 26: Computation with Integers 



1 — I — I — I — I — I — I — I — I — n r~r I I I . K I I P T 
-10 -9 -8 -7 -6 -5 -4 -3 -2 -1 0 +1 +2 +3 +4 +5 +6 +7 +8 +9 +10 

Using the number line above, solve the following problems. 

Item 53. What is the difference between +2 and +4? 

a. 1 teach. ; est.: 54% 

b. 2 stu. score: 58% 

c. ' 3 f 

d. 4 



Item 51. What is the difference between +2 and +5T 



•» 



a. /2 ■ teach, est.: 54% 

b. |_3 stu. score: 50% 

c. 7 

d. 10 



Item 52. What is the difference between -5 and +2? 

: * . \ 

a. 2 teach, est.: 32% 

b. , 3 '" . stu. score: 40% 
z. 5 

d. 7 



Panel Comments : ' The student stores on the items approximated teacher 
estimates-. The average score was 49% for*l*£ objective. .The teacher 
estimate was 47%. The scores appeared to beNow, but "it was hypothesized 
that students were not heavily exposed to the materials tested. .That 
hypothesis was supported. by the JIEP teacher survey data. "Torty-three 
peircent of the teachers reported that their students had received ho 
exposure to the material tested by items 5J and 53. Seventy-one percent 
reported no expqsure to the material Rested by item 52. 



• 18 • 

- 12 J 



Topic I'V: Measurement * 

4 

Seven items tested objective 37., There was one item on objective 40. 
Table 6 shows the results.- 

1 

Table 6 

Objective 37: Recognition of Measurement Facts 

Item 35. How, many'inches are. there in one foot? 

" a. 12 inches teach, est.: 76% 

IT 24 inches ' stu. score: 80% 

c. 36 inches 

d. " 48 inches . 



) 



Item 38. How many quarts are in one gallon? *> 

a. 1 cyjart teach, est.: 60%^ 

b. 2 quarts stu. .score: , 62%* 
*c. 3 quarts 

d. 4 quarts 



r * 
Item 57. Which is tire CLOSEST to-the size of one square 
.centimeter? 



a. A tennis court teach, est.:" 44% 

b. Your thumbnail stu. score: .5?% 
ct A slice of bread 

d. The cover of a record album 



Item 36. How many ounces are there in, one pound? 

.. 4 * 

a. 8 ounces teach, est.: 62% , 

b. 16 ounces * * .stu. score: 52% 
"qT HO ounces 

£ 32 ounces . 



V 



-X3-J9 



Item 56. In the Uni ted Sta tes » we usually buy 
* gasoline by the gal}on. In France, where the metric 
. system is used,- people buy gasoline by the. ■ 



a. meter. teacti. est,: 42% 

b. liter. stu. score: 42%' 

c. quart. 

~d. gram. a% 



Item 37. How many pints are there in one quaft? 



a. 1 pint teach, est.: 59% 

b. 2 pints 1 stu. scor'e: 41% 

c. 3 pints \ 

d. 4 pints - 



Item 58. Box Beholds one liter. How many 
milliliters does it hold? ~ 



a. 1 'teach, est.: 34% 

b. 10 stu. score: 31% 

c. 100 

d. 1,000 



Objective 40: Problem Solving in Measurement 

Itfem 50. tyary earned $1.00 raking leaves. 'Candy 
x bars cost 15 cents. How many candy. bars can she buy 
wlth.f^g. morfey?^ m • • 

> ^ . . * ' > I 

a. 3 , 1 teach. estJ: 52% 

b. 4 .* stu. score: 50% 
c 6 

< jt^i . : 

Panel Comments : The student scAes were not significantly different from - 
teacher estimates for objective 3y. Despite- the large #inge in scores (from 
80% to 31%), student scores yrfpproximated- teacher estimates for almost all of 
the Items. Interpretations/should take into account the amount of student * 
exposure. Eighty-one percent (81%) of the teachers reported that students * 
had been exposed to the content of items 35, 36, 37, and 38, and 51% of them 




described the exposure»as adequate €o. heavy:* ' 0nly56% of tire teachers 
reported that students had been exposed to the content of items 56, 57, and 
58, and only 33* described the exposure as adequate to heavy. The student 
score also approximated th<rteacher estimate for the item related to . 
objective 40. Seventy-three percent (73*) of the teachers reported that 
students had been exposed to the content of the item-. Fifty-three percent 
desc r ibed the exposure as adequate to heavy. 



V Topic V: Algebra .' . - 

S Topic VI: Geometry 
f) and ~ • 

Topic VII: Probability/Statistics,- 

The mathematics panel noted during the test development phase that Algebra, 
Geometry and Probability/Statistics are not included in 'mathematics 
curricula until after fourth grade. Those topics were not tested. 

• " Topic VIII: Personal and Consumed Mathematics 

The test contained nine items on this topic. All* Tour abilities were tested 
with respect to the topic. Table 7 shows the results-. 



Table 7 



Objective 53: Recognition of Personal and Consumer 
* Mathematics Facts 

Item 46-. John has 13 cents.- He wants to buy a 25 
cent toy. How much more money does. he. need? , o 

a. 12 + 13 = 25 / • • teach. e'St.: 77% 

b. 25 - 12 = 13 stu. score 5 : 59% 

c. 25 - 13 = 12 



Item 44. , How many apples did you have '"at the start if 
you gave away 9 apples and have 6 apples left? 



a. 9- 6 = 3' teach, est.: .73% 

V. 9 -t- 6 = 15 » stu. score: 56% 

E7 6 + *3 = 9 ■ , ' 



Itejn 43. Jane and Sue each had 10 cents, Mary had 9 

cents. How much money did the .girls- have all together? 

* ;• * • 

* * » p <$ 

a. 10 + 9+ 10 = 29 teach, est.: 80% 

b. 20 - 9 - 11 stu. score:- 51% 
- c. 9 + 10 =19 > 



Objective 54: Computation in Personal 
and Consumer Mathematics 

" * 

Item 24. Find the difference: > $4.21 



a. ' $?14 teach, est.: 77% 

b. $204" h stu. score: 52% 

c. $2.04 * 
T. SO? * 



Objective 55: Understanding of Personal and Consumer 
MathematicstCoqcepts 



n r^n r i 1 — x; — i — i — i — r 

7:00 8:00 9:00 10:00 11:00 12:00 1:60 2:00 3:00' 4:00 5:00 



The^ line above shows tbe hours/fi*om 
p.m. Use the line' to ^stflve^ the 



Yom t;00 a.m. to 5:00 
following problems. ^ 



Item 54. Peter left home at 2:00 p.m. and arrived 
back home at 5:00 p.m. How many hours was he away 



from home? ^ 



a. 1 hour * ^ /teach, est.: 64% 

b. 2 hours - -! • stu. score: 70% 

c. 3 hours 
IT. 4 hours 



Item 55, Janet worked from 8:00 a.nff to 5:00 p.m. 
She had an hour for lunch,. How many hours did she - 
work? 



a, 
b, 

ST 



3 hours 
5 hours 
8 hours 
<L0 hours 



teach, est,: 58% 
stu. score: 58% 



Objective 56: 



Problem Solving in Personal 
and Consumer Mathematics 



Item 48, It takes Fred five minutes to wash oi^e 
indow. How many minutes will it take him to wash ten 
indows? 



a. '25 minutes 

b. 15 minutes 

c. : 50 minutes 
"(H 60 minutes 



teach, est, 
stu. score: 



70% 

" 75% 



Item 49, A sports car owner says that the car gets 22 
miles per gallon of gasoline. How many miles could 
the car go on seven gallons of gasoline? 



a. 144 miles * teach, est.: 65% 

b. 154 miles stu. score: 65% 

c. 164 mi les 

d. 174 miles - 

Item 50. Mary earned $1.00 raking leaves. Candy bars 

.cost 15 cents. How many candy bars can she buy with 



her money? ' ' 

/* v . 

a. \3 f teach, est'.: 525$ 

b. • 4 I stu. score: 50515 
C. 6 \ ' v. , 



-J 
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Panel comments : For objective 53, -the average student score (55%) was * 
significantly lower than the teacher estimate (77%)*. The teacher survey 
indicated that students \vere exposed tp the material and thst the items were 
of an appropriate difficulty level. However, panel discussion of the 
results led- to a reappraisal *of the items themselves* The panel's judgment 
was that the items needed revision. The correct responses are not 
straightforward for any of* the three items. Additionally, all. the answer 
choices for item 46 are mathematically-correct, which makes it a bad iten^ 

The student score (52%) was considerably lower than the teacher estimate 
(77%) for item 24 (objective; 54). When analyzing the results for that item, 
parte.lists noted that 39% of the students chose* response "b" (an incorrect 
response). Testing experts caution that speculation about choice of 
incorrect responses should be done only in exceptional cases. Item 24 was 
judged to be an exceptional case, and Jha -panel commented that Students who 
subtracted the digits 217 correctly from the digits 421 would obtajn v 204 
(£he digits of incorrect response" choice "b 1 ^). They expressed concern th,at 
the 39% who chose response "b" may have attended only to mechanics, paid 
insufficient attention to the decimal point, and not used enough common 
sense to note that one who has four dollars could not end uprwith two 
hundred dollars by 'giving away two dollars. 

The student score (64%) approximated the teacher estimate (61%) for 
objective 55. The same was true for objective 56 (student score: 63%; 
teacher estimate: .62%). ' ~ * 
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Chapter 3 



Discussion of ,the Results 

9 

The mathematics panel was asked to discuss, the results of the HEP data and 
give their reflections.- The comments were based primarily^on 1) the 
performance df.4th, 8th, and 11th grade Illinois students on the 1976, 1978, 
and 1979 HEP tests, 2) the, results of the 1979 HEP teacher surveys-, and 3) 
the findings of relevant 'mathematical and educational research. 

The panel noted that two factors emerged from the 1979 fourth grade test 
•(See Chapter 4) and suggested that further research be done to replicate 
that finding. They indicated surprise that the factors appeared to be 
ability factors rather than topic factors. . The nature of the factor , 
structure has important implications for curriculum, teaching, and learning. 

*pj'e panel noted that the HEP has been a census-type test until now. It has 
'tested a representative sample of all 4th grade. mathematics content and 
' provided a snapshot of general student performance. The panel suggested 

that future tests take a new direction. • - « 

? ■ 

One suggestion was that comparisons be .made across years and across grade 
levels. The HEP has charted. trends of general, mathematics performance » 
singe 1978 {See the 1979 HEP Annual Report 1 for the trends from 19-76 to 
1979). The panel suggested that trends should be charted for specific 
objectives, topics, and abilities where sufficient HEP data exists. 
Comparisons could also be made across grade levels where there 1s comparable 
data.- I ^ • * 

A second suggestion was Mat a long-range HEP research program should be 
developed. Future HEP tests should focus on specific objectives, topics, 
and abilities. A research design should be utilized to test specific 
hypotheses. The aim should be to move from description toward explanation. 
The development of focused tests would provide sound tests which school 
districts and teachers cjaUld use .to good advantage. The results of the 
hypothesis testing couW indicate c'urricular strengths and weaknesses and 
point out needs for educational emphasis. 



I 1979 AnrfuaL Report of the 'Il linois Inventory of Educational Progress 
Springfield, Illinois 627.77: Illinois State Board. of, Education, 1981 
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Factor Analysis Results 

The HEP was first administered in,1976._36sults ^ rom the te v st 9 avef base 
Ijne data regarding mathematics acfnevement. In 1978, the objectives were 
revised in' terms that were more easily understood and more amenable to . u 
fise^rch on learning processes as they occur in students. Resu^HI were * 
subjectecT to factor analysis, a statistical procedure which -helps identify- 
student abilities and the strategies which they, use in learning. 

V 

Factor*analysi£ is, a highly technical mathematical and statistical procedure 
which cannot be- fully explained here.-' However, an intuitive understanding 
of factors and their derivation is possible.' Fred Keflinger, in his book 
Foundations of Behavioral Research (1973) wrote: . 

Factor analysis is a method for determining the number and nature of the 
underlying variables among large numbers of measures. v 

Generally speaking, if two tests measure the same thing, the score? 
obtained from them qan be added together. If, on tfce other hand, the 
two tests do not measure* the same thing, their stores cannot be added 
together. Factor^ analysis tells us, in effect, what tests {^measures 
can be added and studied togethefc^rather* than separately.' It thus * 
limits the variables with which/the scientist must cppe. Ifc-atoj 
(hopefully^ helps the scientist to locate and identify unities or', 
'fundamental properties^/inderlying tests and measures. 

A factor is a construct, a hypothetical entity that is assumed to ' ' 
underlie tests and test performance. A number of factors have been 
found to underlie intelligence-, for example: - verbal ability, numerical 
ability, abstract reasoning, spatial reasoning, and mpmory. 

A HYPOTHETICAL EXAMPLE 

Suppose we administer six tests to^a large number of seventh grade . 
pupils. We suspect that the six -tests are not measuring si,x,*but some 
smaller number of variables. The tests are: vocabulary, reading, *' 
" ^synonyms, numbers, arithmetic (standardized tests), and arithmetic 
(teacher-made tests). The names of these tests indicate their nature. 
We label them respectively, V; R, S,§|P;*AS, and AT. (The\lasrtwo 
tests, vthouyh both arithmetic, .have different contents and. . j 

reliabilities. We assume a good reason for including theMjoth in a 
test battery. ) Aftex the tests are administered ayjd scored, 
coefficients of correlation are compute^bejtween 'earclPtest and every 
other test. We lay out .the r's in a' correlation matrix (usfually called 
R matrix).'* The matrix is given in Table 37M (Table 8).. > ' y*~~ 
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Table 8 



TABLE 3711 R MATRIX: COEFFICIENTS.OF CORRELATION AMONG SIX TESTS 



Cluster I 





V 




S 


N 


AS 


AT / 


V 




.72 


.63^ 


i .09 


.09 


.oe 


R / 






^57^ 


.15 


.16 


.09 


s C 


.63 


.57 ^ 




.14 




.09 


N 


.09 


.15 


.14 




— T7 r 


^63^ 


AS 


.09 


.16 


.15 > 


/<57 






AT 


.00 


.09 


.09 ( 


,63 


.72 





Cluster II 



...How many underlying variables or factors are there?... The 
• factors are presumed to be underlying unities between the test 
performances. They are reflected in the correlation coefficients. 
If two or more tests are substantially correlated, then the tests 
share variance. They have common factor variance. They are 
measuring something in common. 

...There are two factors. This' is indicated by the clusters of r's 
circled and labeled I and II in Table 37.1. Note that V correlates 
with R,.?2; V with S',.63; and Rwith S>.57. V, R, .and S appear to 
be measuring something in common. It is important to note, • 
however, Jfchat the tests' in Cluster I, though themselves 
intercorrelated, are not to any great extent correlated with the 
ttests in Cluster II. likewise, N, AS, and AT, though themselves 
intercorrelated, are not substantially correlated with the tests V, 
R, and*S. What is measured in common by the tests in Cluster I Is 
evidently not the same as what is measured in common by the tests' 
in Cluster II. There appear to be two clusters or factors in the 
matrix, (pp: 659-661). 2 

For furtheXdiscussion of factor analysis, see K^rlinger (1973) pp. 659-692 
and cited references. 



Results for Factors jlnd Hypotheses 

» 

Hypotheses/ 1 was tjfiat four ability/f actors would be indicated. The 
hypothesized factors were: 1) recognition of mathematical facts, 2) 
computational ski i ts, 3) an understanding of concepts, and 4) problem- ■ 
solving ability. The data< showed 'two factors; F.actor I wal composed of 



2 Fred N. Kerlinger. Foundations of BehavioraUResearch (Second 
Edition)., New York:* Holt Rinehart, and Wirtston, Inc., 1973. 



A 



items related to problem-solving ability. Factor II was 1 composed of items . 
related to abilities 1, 2, and 3 and^was labeled learned mathematical facts, 
computations, and concepts. ' * 

Hypothesis 2 was that there woyld be five topic factors, one factor for each 
topic which was measured. Hypothesis 2 was not supported. No topic factor 
was indicated. 

Hypothesis 3 was that teacher estimates would be significantly higher than ' 
the student scores for the items loading on the factors. Hypothesis. 3 was 
"not supported.' Tables 9 and 10 show the results with respect to hypotheses 
1, 2, and 3. The identical means and similar standard deviations indicate 
that there is no significant difference. 



Table 9 



Factor I: Problem Solving 



Objective^ 
40 



item 
50 



Teacher 
Estimate 
52% 



Student 
Performance 
50% 




70% 
•65% 
52% 



.60 
.09 
4 



75% 
65% 
50% 



.60 
.12 

■ 4 



t = - .026 + 
+ N.S. 



df = 6 



- 22 - 



28 



Table 10 



Factor, II: Learned Material' for Student 
Abilities in^Recognition, Computation, and Understanding 



/ 







Teacher 


Student 


Obiective 


Item 


Estimate 


Perf ormanc 


1 


30 , 


83% 


78% 




31 


74% 


40% 




. 34 


69% 


62% 


.5 . 


29 


77% 


70% 




32 . , 


33% 


18% 




33 


32% 


24% 




42 


57% 


74% 

El 


-7 


39 


51%' 


47% 




40 


44% 


29% 


Q 


26 " 


85% 


86% 


10 


23 , 


76% 


78% 




25 - 


77% . 


* 83% 




, 27 


79% 


73% *• 




' 28 . 


81% 


78% 


** 

2& 


51 


54% 


50% 




52 


32% 


40% 




.53 


54% 


58% 


37 


. 35 


76% 


80% 




36 


62% 


52% 




37 


59%- 


41% 


t 


38 


60% 


62% 




56 


• 42% 


42% 


•* 


57 


44% 


53% 




58 


34% 


- 31% . 


53 


43 


• „ 80% 


. - 51% 




44 


73% 


56% . 




46 


• 77% 


• 59% 


55 


54 


64% 


*v 70% 


c 


55 


58% -.- 


>V ■ • -58% 


Mean 






• Df 


," Standard Deviation 


.17 


:19 


H 




.-29 


29 


t = 1.03+ 


• 

df = 56 




.001 v 














- 23 - 








29 





Hypothesis 4 was that the teacher estimates would be higher than the student 
scores for the items of the eight measured objectives. Hypothesis 4 was 
supported only for objective 5-3 precognition df consumer mathematics facts) 
yhere the r* indicates the degree to which student performance differed from 
teaeh-T. estimates. Table 11 shows the results. 



Table 11 



I-test Results for Factors and Objectives 
Teacher Estimates vs. Student Scores 



Label 


Teacher 
Mi 


Estimates 
S.D. 


Student 
M? 


Scores 
S.D. 


n 


t 


df 


r2 


Factor I 


> 

.60 


.09 


.60 


.12 


4 


-.03+ 


6 


— 


Obj. 40 


0 








. 1 








Obj. 56 


.62 


.09- . 


.63 

<*> 


.13 


3 


-!l2 + 


4 


— 


Factor 11 

1 Mw to \J 1 A A 


.62 


.17 


.57 ' 


.19 


29 


1.03+ 


56 


.001 


Obj. 1 


;68 


.14 


.63 


'.17 


4 


1.18* 


6' 


.06 


Obi.' 5 


.50 


.22 


.47 


.30 


4 


.19+ 


6 




Obj. 7 










2 








Obj. 9 










f 








.Obj. 10 


.78 


.02 


.78 


.04 


4 


.13+ 


6 




Obj. 26 


' M7 


.13 


.49 


.09 


3 


-.29 + ' 


4 




.Obj.. 37 


-.54 


.15 ; 


.52 


.16 


7 


.28 + 


12 




Qbj. 53 




.oT 


.55 . 


.04 


3 


7.08** 


4 


.89 


Obj. 55 










2 








NON- FACTOR 












r. « 






12 


.-703 


.06 


.69 


.040 


3 


/ 39 + . 


4 





T-test results. .are for one tailed test 
.** significant^ < .01 * , 

■ + N.S. 



* * 4 



Additional Analyses 



In order to identify hypotheses for future research, post hoc analyses of 
the data were done. Correlations were computed between teacher estimates 
and. student scores to explore the relationship between the two. This was 
done- for each factor as a whole arid for each measured objective. 
Significant correlations were found for Factors I and II and for objectives 
5, 26, 37, and 56 as indicated by the degree to which student performance 
was accounted for by the teacher estimates (r 2 ). Table 12. shows' the 
results. • 



*\ Table, 12 



Teacher Estimates Correlated with Student Scores ■ 
by Factqr^and Objective for the 1979 Fourth Grade HEP. 



Label 




r 


df 


r fc 


Factor I 




.99*** « 


6 


.98 


Factor II 




.81*** 


56 


.66 


Objective 1 




.14 


6 


.02 


Objective 5 




.90** 




.81 


Objective 10 




■.37 + 


6 


.14 


Objective 12 




.19+ 

■ • 


"4 


.04 


Objective 26 




.90* 


4 


.81 


Objective 37 




.83*** • 


12 


.69 


Objective 53 




-,552 + 


4 

• 


.30 


Objective 56 




.99*** 


4- 


.98 


* 1 significant p 


< 


.05 , 


• 




** significant p 


< 


.01 






*** significant p 


< 


.001 6 . , 


* 





In another post hoc' analysis, T- tests were computed comparing student scores 
among Objectives, Six T-tests were significant In partipular, student 
performance was higher for objectives 10 and 12 than for objectives 26 and 153 
as indicated by the r 2 s. Twenty-two of the twenty-eight tests were not 
significant. Table 13 shows- the results. 



Table 13 



T-test Results between Objectives 



Obj. 


Mean]. S..D. i nj 


Obj. 


Meari2 


S.D.2 


n 2 


t 


df 


r2 


1Q 


.78 


.04 


" 4 


12 


.69 


.04 


3" 


2.99* 


5 


.53 


10 


.78 


.04 


4 


53 


.55 

< 


.04 


-3 


7.30*** 


5 


:88 


10 


.78 \ 


.04 


' 4 


37 


.52 


.16 


7 


3.16* 


9 


'.50 


10 


.78 

i 


.04 


.4 " 


26 


.49 


.09 


, 3 


5.76** 


5 


.82 


12 . 


.69 


.04 


3 


53 


.55 


.04 


3 


4.10* 


'4 


.72 


12 


.69 


.04 


3 


26 


.49 ' 


.09 / 




3.41* 

* 


4 


.64 



T-test- results are for. two-tailed tests 
/. * significant p <- .05 « , 

** significant p < .01 
• *** significant p <. .001 ' 




• APPENDIX A 

» * 

' INDEX OF' MATHEMATICS OBJECTIVES 
FOR THE '1979 FOURTH GRADE IlEP 



Objec^tivfe Item ' Page(s) 



4 

.1 


30 


6 


4 
1 


31 


6 


4 
1 


34 


6 


4 
1 


• 4 

41 


• , . 6 


. 5 


29 


. • . % 


5 


32 


8 


5 


33 


8 


5 


' 42 


7 


7- 


39 


8 


7 


40 


9 


9 


26 


9 


10 


23 


4 r\ 

10 


10 . 


25 


10' 


10 


27 


10 


10 


28 


10 


12 


45/ 


11 


12 


47 


10 


12 


49 


11 


26 


51 


4 /t 

12 


26 


- 52 


f 12 


26 


53 


12 


37 


^ 35 


13 


37 


36 


14 


37 


37 


4 *"> 

13 


37 


38v 


13 


37 


56 


l4 


37 


57 • 


13 


37 


58 


14 


40 


-50 


14 


63 


43 


16 


53 


44 


IS 


■ I 3 


46 


. „ 15 


54 * > 


24 . 


V. 16., 


■ 55- • 


54 


'16 


55 


55 


17 


56 


48 


17 


56 


49 


17 


56 


50 


17 



APPENDIX B 

INDEX OF MATHEMATICS ITEMS 
< FOR THE 

1979 FOURTH GRADE MATHEMATICS HEP 



■em Objective Page(s) 



23 


10 . 


10 


24 


54 


• 16 


25 


10 


• 10 


26 


9 


9 


27 


10' 


10 


28 


10 • 


10 


29 . 


5 


8 


30 


1 j 


6 


31 


• 1 / 


6 


32 


5 


8 


33 


5 


8 


34 


1 


6 


35 . 


37 


13 


36 


• 37 


13 


37 


37 


14 


38 


37' 


13 


39 


7 


8 


40 


7 


' 9 


41 


1 


6 


42 


5 


7 


43 


53 


16 


44 * 


53 


15 * 


45 


12 


11 *"•■ 


46 


53 


15 


47 


12 


10, 


48 


56 


17 


49 


/ 12,56 


11,17 


50 / 


40,56 


14,17 


51 / 


26 


12 


52 


26 


. 12 


53 • 


. 26 . 


" 12 


54 


55 


16 


55 


55 


17 


56 


37 4 
37 


14 


57 v 


13 


58 


37 


14 



1 



APPENDIX C 



STATE BOARO OF EDUCATION 
ILLINOIS OFFftt OF EOUCATiON 
Prog<*m Evaluation »i»d Assessment Scchon 
100 North First Street 
Sprtngt,cid,IM»rto«» 63777 



4th GRADE l\flATH ATTENDANCE CENTER.TEACHER SURVEY 



Ml 



! I 



(I) 12) (3) 1*1 



iNSTRUCTiONS Stirling with Co>'un>n 8, inai& 
farm to your bwldinq principal when compteted\ 



5 a 



AMEN WERfc STUDENTS 
EXPOSEO TO THE SUB 
JECT MATTER' 

1 E»POVd 0"Or to On j 
qr«Je Ifv«1 

2 Exposed this yea* 
**e not been *»*pottd 

n 



23 



-2L. 



26 ' 



-21. 



-22_ 



30 



_32_ 



_34_ 



TO WHAT 

STUDENTS 

TOTMESUl 

1 HeatHy 

2 Adwjtuv 

3 Mtnimjily 



|yeu' tesponte by pUong * number co/'ttpondmg to ycut opinion m the spptoprtsle bo* Return the 

IEE HAVE HOW IMPORTANT IS M A$| DOES THE EXER 

rSSLf. x JSSP^ T * RV OF THIS SKILL', ,OSE MEASURE 
:CT MATTER V ' 



Ver^ifnportant 
Important 
Not Impofuni 



SUBJECT MAT- 
TER' * 
\ Yei 
2 Ho 



CUL?V?N0EX FI AT PERCE NT AGE 

CULTYINOEX Of STUDENTS WILL 

1 TooEaw ANSWER THIS ITEM 

3 Too 0>H'CuM 



Si 

z 



WHEN WERE STUOENTS 
EXPOSEO TO THE SUB- 
JECT MATTER' - 

1 E*povxJ pro/ to tins 
grade >eve> 

2 Exposed th«s year 

3 Have not been exposed 
lit 



_42_ 



50 



«S1 



53 



54 







3fi 




. 27 J 


_ 38 








4Q 




4V 




42 





55 



56 



57 



58 



i 



TO WHAT OEGREi HAVE HOW IMPORTANT IS MA$j DOES THE EX?ER 

l^£^H!£fK^Pv TEnv 0F TH, S SKILL' , ClSE MEASURE 
TO THE SUBJECT MATTER 'l, , , *SurjECTMAT 

1 H*a<I v » V«ry .mpo,t*Ot ; SUBJECT MAT 

2 Ad^tely I? E5Si_. " "« 

2 No 



Minimally 



3 Not ImpoM^ii 



-JILL 



nnSS'SrST 1 VVH AT PERCENTAGE 
CULTYINOEX OFSTUOENTSWU 
Too Easy ANSWER THIS ITEM 

Apcrotr mi.» Level CORRECTLY > 

Too 0»li<cuH 



t 



<»3 111 



- 28 - .34 
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Chicago Board of Education 
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Department of Mathematical Science 
DeKalb, Illinois 
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